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1.  OTTRODUCTION. 


P.  Huber  introduced  Che  simultaneous  M-estimates  of  location  and 


scale,  n  and  a,  based  on  observations  y,, . ,y  ,  as  a 

x  n 


solution 


(T  ,  S  )  of 

u  U 


(l.D 


Z  ♦($  (y.-T  ))  -  0, 

i-1  a  1  a 


1  X(SVy.-T  ))  "  0. 
i-1  a  1  a 


where  and  x  are  suitably  chosen  functions.  In  most  cases  Is  an 
odd  and  X  an  even  function.  In  particular  he  studied  M-estlmators 
generated  by  functions  p  and  x  of  the  form  (Huber's  Proposal  2) 


(1.2) 


♦  (x)  -  slgn(x)  min(|x|,k), 
X(x)  •  min(k2,x2)  -  Bk, 


with  chosen  to  make  I(x(*))  "0  If  the  distribution  of  z  is 
N(0,1).  Vs  refer  to  the  books  by  Buber  (1981)  or  Hampel  at  al  (1986) 
for  a  review  of  the  properties  of  the  K-estiaetors.  There  it  Is 
proved  that.  If  Che  observations  are  1.1. d.  with  a  symmetric 
distribution,  ♦  le  an  odd  and  x  an  even  function,  It  follows  chat 


(1.3) 


nh(Tn^)  €  AaN(0<  o^O*2^)) /(E<*  ’  (z^) )2)  , 
n*(SQ-a)  e  AeN(0,  o2Z(x2(*1))/(E(zlX,(*1)))2). 


where  z,  -o”A(y,-h).  In  this  case  T  and  S  are  asymptotically 
i  i  n  a 

Independent. 

In  real  time  situations,  where  the  estimate  is  updated  when  new  ob¬ 
servations  are  obtained,  it  is  often  preferable  to  use  a  recursive 
estimator.  Martin  and  Masrellez  (1975)  pointed  out  the  possibility  of 
constructing  recursive  M-estlaators  using  a  stochastic  approximation 
approach.  The  classical  results  for  stochastic  approximation  algorithms 


can  b«  applied  rathar  straightforwardly  to  investigate  tha  asymptotic 
propartias  of  recursive  M-estlaators  whan  tha  observations  are  inde¬ 
pendent. 


Tha  behaviour  of  recursive  M-estlaators  in  dependent  situations  ere 
less  known.  The  pure  location  parameter  case  with  a-dependent  and 
strongly  regular  observations  is  studied  in  Holst  (1980)  and  Holst  (1984) 
respectively.  For  practical  use  soaa  recursive  estlaator  of  scale  must  be 
constructed  and  coupled  to  tha  estlaator  of  the  location  parameter. 
Recursive  scala-estlaators  which  are  variants  of  the  median  absolute 
deviation  are  studied  in  Holst  (1985). 

A  broader  approach  to  the  estimating  problea  is  to  construct 
recursive  algorithms  based  on  (1.1).  In  this  paper  we  prove  strong 
convergence  of  estimators  of  the  fora 


(1.4) 


Vl  ’  nn  +  («H'l)’Xl>V(^1(yiH-rnn))* 

an+l  "  ffn  +  (a^1)‘l2fn2)V(^1(3riH.rnn))' 

arbitrary  and  finite. 


and  mainly  we  discuss  the  following  choice  of  H^  and  H^ : 

Q  Q 


(1.5) 


a“1>  ‘ 


-l 


H 


(2)  .  — 1  _  vl  .  , 1  ,  . .. 

h  - (n  1i1ffi-i(yi-Vi)x  (ai-i(yrni-i))) 


-i 


With  the  notation  v  we  mean  v  truncated  above  and  below. 

We  consider  the  ease  when  the  observations  {y^}^  can  be  described 
by  a  strictly  stationary  process  satisfying  csrtaln  strong  mixing 
conditions.  For  the  analysis  we  sssuae  that  ♦  and  x  satisfy  soms 
regularity  conditions.  These  are  introduced  In  Section  2. 

Strong  convergence  of  nQ  and  oq  and  also  of  the  adaptive 
sequences  H*“^  and  H^  is  proved  in  Section  3. 


In  Englund,  Holst  and  Ruppart  (1987)  v«  prova  a  strong 
raprasantatlon  thaoraa  for  tha  astimators.  It  is  possible  to  derive 


3 


asymptotic  distributions  using  this  thaoram  togathar  with  suitable  forms 

of  tha  Cantral  Limit  Thaoram.  Whan  tha  observations  ara  a  saquanca  of 

i.l.d.  variables  it  follows  that  (nn,aQ)  has  tha  saaa  asymptotic 

distribution  as  tha  nonraeurslve  estimator  (T  ,S  ).  Constants  on  the 

n  n 

asymptotic  distribution  is  givan  in  Section  4.  Further  we  discuss  whether 
our  choice  of  and  is  optimal  or  if  it  is  possibla  to  find  a 

batter  one.  Va  consider  a  gain  matrix  which  might  be  preferred,  but  this 


trlx  contains  unknown  parameters  which  like  a  and  b  must  be 


estimated,  and  this  leads  to  an  expansion  of  tha  dimension  of  tha 

parameter. 

In  Section  5  we  illustrate  tha  behaviour  of  tha  estimates  for 
Aiber's  Proposal  2  whan  the  observations  ara  i.l.d.  with  a  contaminated 
normal  distribution. 


2.  NOTATIONS  AND  ASSUMPTIONS. 


To  incorporate  tha  adaptive  sequences  and  we  rewrite 

D  Q 

the  algorithm  in  tha  following  way 


(2.1) 


where 


Vi  •  •»  +  "‘+I>  V'VW- 

0 0 ,  Hq  arbitrary  and  finite. 


Further 


9n  “  (V  WV  • 


h(0n’W 


■ 

V(Vi) 


-  *n 

-  bt 


"a  '  Vl'VVl1 


(2.2)  eB  -  dUj(  «£*.  ?£l,  1.  1  ) 


With  the  notation  oq  vs  mu  0q  truncated  above  by  a  large  positive 
nuaber  and  belov  by  a  seal!  positive  nuaber  so  that 


Vi  i£ 


an  «  V 


(2.3)  a  -  |  a  if  v  S  a  i  v  , 

n  in  i  a  i 


*2  if 


■v. 

0  >  V„. 

n  2 


Throughout  the  paper  it  is  understood  that  i  a  i  The  above 

%  ^ 

notation  vill  also  be  used  for  a  ud  b  .  Note  that 

q  n 


*  •  n  £  *f(«a) 

-  l-l  J 


b_  -  a  *  u.x’(u.) 
a  J-i  J  J 

so  that  vlth  H  defined  as  in  (2.2)  ve  get  algorltha  (1.4)  with  H*'- 

Q  Q 

ud  given  by  (1.5). 

Q 

Define 


h(x)  •  E(h(x,y1)) 


ud  let  6  be  the  solution  of  5(9)  -  0,  where  6  -  (n,o,a,b)  ,  tha 
is  with  -  o'^y^-o) 


(2.4) 


£(♦  (r^ ) )  “  °* 

E(x(tj))  -  0, 
E^Hxj))  -  a, 
E(*1X,(*1))  -  b. 


SW5 


‘  V.  -  o 


,n 


»*2 

i‘2 

if 

V 


v 


% 

m 


Let  F®  •  F(y  ...... y  )  be  the  ff-algebra  ganeratad  by  the  random 

varlablaa  y, . ,y  .  Tha  sequanca  of  strong  mixing  coefficients  a 

in  x 


is  defined 


a.  -  sup  a(F®"  ,F  )  -  sup  sup  |P(FG)-P(F)P(G) |  . 

*  ■  r£FV1.0£F* 

1  a 

£ 

Further,  we  need  tha  following  notations  n(k)  ■  Ck  ]  for  soma 
5 >2  and 

n(lc+L)-l  .  , 

0.  -  2  <i+l)“l  -  ^(k*1). 

K  i-n(k) 

The  constant  C  is  positive  and  may  change  from  line  to  line.  For 
shortness  va  usually  write  z  instead  of  z^  below. 

Finally  we  list  the  following  assumptions  for  later  use. 

Al.  Tha  sequence  of  observations  {y^}^  is  strictly  stationary  and 
strong  mixing  with  2^  <  "  for  soma  0  <  c  <  1.  The  marginal 

distribution  is  symmetric,  continuous  and  positive  in  a  neighbourhood 
of  n. 

A 2.  The  function  h(x,y)  is  bounded  and  Lipschltz-contlnuous  both  as  a 
function  of  x  and  y  l.e. 

||h(x1,y)-h(x2,y)||  S  IUj^II 
l|h(x.yl)-h(x,y2)||  S  *2  ||yj-y2|| 

for  some  positive  constants  and  Kj. 

A3.  The  function  <K*)  is  bounded,  increasing  (strictly  Increasing  in  a 
neighbourhood  of  zero)  and  odd.  The  function  x(')  is  bounded,  Increasing 
on  (0,a)  (strictly  increasing  in  a  neighbourhood  of  zero)  and  even. 

A4.  The  function  h(*)  satisfies  h(9)  •  0. 

AS .  The  following  functions  exist  and  are  bounded: 

*(k)(x)  for  1  S  k  S  3,  xVk)(x)  for  1  S  k  S  2,  xV3)(x), 

X(k)(x)  for  1  S  k  S  2  and  xkx(k)(x)  for  1  S  k  S  3. 


6 


Not*  that  A2  holds  If  th*  functions  xf'(x),  xp"(x),  xx’ (x)  and 

2 

x  x"(«)  exist  and  ara  bounded  and  that  A5  is  a  strong  assumption  which 
is  used  In  Section  4  only. 


3.  ALMOST  SURE  CONVERGENCE. 


In  this  section  ve  study  almost  sure  convergence  of  the  algorithm 

(2.1).  It  Is  proved  in  Theorem  3.1  that  9  9  a.s.  ,  where  9  solves 

n 

5(9)  -  0.  The  proof  consists  of  two  parts.  Following  Ruppert  (1983)  we 
show  that 

n(k+l)-l  .  . 

(3-1>  Vfi)  ■  9„(k)  ♦  t^(B  HiE<9„(k)>  +  9<l  >  • 

This  Is  accomplished  by  writing 

n(k+l)-l 

<3-3)  Wo  *  9»(k>  +  t^(k)  Bi5<W + 


n(k+I)-I 


+  i^(k>  a+1,'1WMW>W-i:(W)  + 


n(k+i)-l 

+  i-n(k)  (1+I)’  (VHn(k))(h(8n(lc)^i+l>-5(0n(k)))  + 


.-l. 


n(k+l)-l 

+  i-nE(k)  (1+1)’lHi(h(ei’7i+l)‘h(9n(k)*7i+l)> 
n(k-fl)-! 

-  8,..  +  Z  (1+1)”  Q.h(9  ... )  + 
n0t)  l-n(k)  1  n(k) 


+  H.nOt+l)-!  +  Sk,n(k+1)-1  +  Tk,n(k+1)-1 


say.  «d  then  v.  prove  that  Tk,n(k+1)-1 

all  are  o(k_1).  The  most  Involved  expression,  R^  n ^  *  is  handled 
In  Lemma  3.3,  which  is  a  lemma  by  Ruppert  (1983,  Lemma  3.2).  The  second 
part  of  the  proof  Is  to  show  that  (3.1)  is  sufficient  to  establish 


*»s 


convergence.  This  Is  verified  using  Learn*  3.4,  which  Is  proved  by  a 
technique  similar  to  the  one  used  by  Bluai  (1954). 

OB 

In  Leaasa  3.1  we  prove  that  (g(y<) } .  Is  a  mix  In  gale  with 
parameters  t>  of  size  and  c  a  constant  If  g(*)  Is  a  bounded 

01  Q 

function  with  E(g(y^))  -  0.  For  a  definition  of  mixlngales  and 
notations,  see  MeLeish  (1975).  Also  the  result  In  Lemma  3.2  Is  a 
mlxlngale  Inequality  by  McLelsh  (1975,  Theorem  1.6). 


I-EMKA  3 . 1  Let  g (• )  be  a  bounded  Borel-measurable  function  with 
E(g(y^))  -  0.  If  A1  holds  then  (g(y^)}j  Is  a  mlxlngale  with 


parameters 


of  size  >^2  and  c  a  constant, 
n 


Proof  Let  F°  •  F(y . .  }.  Lenoa  2.1  by  McLelsh  (1975)  with  p 

M  m  m  n 

and  r  -  •  gives 


|E(gan)|F^*)-E(g(Yn))||2  -  ||E(g(Yn)|F^ 


S  2(2Js+l)/a(F^*,  Fn)ll*CTn)H- 


w 

S  Co’  , 


L  •  1— C 

that  Is  ♦  -  a  and  c  -  C.  The  fact  that  l  a  <  -  for  some 

mm  n  l 

0  <  e  <  1  Implies  that  ♦  Is  of  size  -*2  according  to  McLelsh 

01 

(1975,  p.  831).  This  proves  the  lemma.  1 


LEMMA 


3.2  Let  {gCy^)}^  be  defined  as  In  Lemma  3.1.  Then  there  exists  a 


constant  c  such  that 


E(maxj  Z  d.g(y .)l  )  i  c  I  d; 
nSm  1-1  1-1 


for  all  m  and  constants  d.,...,d  . 

1  01 


Proof  It  Is  obvious  from  Lemma  3.1  that  (d^g(y^)}^  is  a  mlxlngale 

with  parameters  ♦  of  size  and  c  -  d  C.  Theorem  1.6  by  McLelsh 

n  a  a 

(1975)  proves  the  lemma.  0 


LEMMA  3.3  If  A1-A2  hold  than 


sup,  max  0.  1  ||  Z  i_1(h(x,y  ,  )-h(x) )[|  -  0 

xeR  n(k)SA<n(k+l)  i-n(k) 


whan  k  ♦  •. 

Proof  According  Co  Support  (1983,  Laoaa  3.2),  vs  hava  Co  verify  his 
assuaptlons  A3-A6.  A3  is  obvious,  A4  is  exactly  Lemma  3.2 
abova  if  r  ■  •  and  A5  is  satisfiad  sinca  h(x,y)  is  bounded. 

Finally  A6  follows  from  Che  LipschiCz  continuity  of  h(x,y)  as  a 
function  of  y.  This  proves  Lasna  3.3.  a 

LEMMA  3.4  Let  t(*)  be  a  bounded  function  from  Rn  to  R,  x^  an 
alaaant  of  R^  and  (x^)  a  sequence  of  r.v.  satisfying  the  following 
assumptions: 

Bl.  x£^  -  ^  «  D^t(x^)  +  0(k_1)  a.s.  for  soma  positive  sequence 

r  <1*  -»1  •] 

ID^/j  satisfying  K^k  S  S  where  Kj  and  K2  are  positive 

constants. 

B2,  For  all  y  >  0  there  are  >  ®  satisfying 

sup  t(x^)  •  -d^,  where  the  supreaua  is  for  (x^  :  x£^  >  x^+y), 
and 

inf  t(Xj.)  ■  ^2*  the  infiaua  is  for  tx^  :  x£^  <  x^  -y), 

for  all  ki  Y 

th.D  *<»  -  »«>  .... 

Proof  Assuaa  that  x£^  ♦  ".  The  assuaptlons  oaks  it  possible  to  find  a 
constant  such  that  D^tCx^)  +  0(k~*)  <  0  for  k  >  N^,  and  thus 

x^|  <  x^>  and  hence  we  get  a  contradiction.  (The  case  x£^  ♦  -*  is 
treated  in  the  seas  way.)  Nov  assuaa  that  x£^  doesn't  converge,  that 
is  liainf  x£^  <  llasup  x£^  ,  and  also  assuaa  that  limsup  x£^  >  x^. 
(The  case  llasup  i  x^  is  handled  by  a  similar  argument.) 

Define  y  from  Che  relation  llasup  x£^  -  x^  +  3y.  Take  N^  so  large 
that  -D.d.  +  c(k  *)  <  0  for  k  >  N,.  Then  w*  can  find  N-  4  n,  m  >  n+1 


such  that  x  J 


< 


'  *  +  2Y 


<  x^J'  <  xVJ/  +  Y,  x‘J/  +  >  S 


for  k  -  n+l,...,a-l  and  x^  >  x^  +  2y.  This  is  possibla  since 
-  * 


♦  0.  NOW 


m-1 


x(J)  -  x(j)  -  l  (D.t (x.  )  +  o(k-1))  <  D  t(x  )  +  o(n_1) 
a  n  ,  x  x  n  n 


k«n 


and  this  quantity  can  b«  made  arbitrarily  small,  which  is  a 
contradiction. 


Theorem  3.1  will  now  be  stated. 


THEOREM  3.1  Let  9  be  generated  by  algorithm  (2.1).  If  A1-A4  hold, 

_  ,  —  i- —  n 


then  9  ♦  9  a.s.  as  n  *  •. 
n 


Proof  The  first  part  is  to  prove  that 
(3.3)  9 

For  n(k)  S  1  <  n(1c+-l)  we  have 


n(k+-l)-l  , 

n(k+l)  “  9n(k)  +  ^  Cl+iy  Hi5<9n(k)>  +  *(k’  >  ’ 


9t+l  -  •  *  ♦  (**1)  ‘V<VW 


.-u 


•.«  +i-i(k)(i+l)  Hih(9i'yi+i) 


■  +  1  (L+1)~^H, h(9  » )  + 

n(k)  i-n(k)  1  n(k) 


.-1. 


+  :m(i+1>  Hn(k)(h(9n(k)^iH-l>-h(9n(k)))  + 

i*n  kk.) 


,-1, 


+l4(k)  W+l>  ‘"i' W  <h<,»(IO  ’  W^Vm  > ; 


.-l. 


♦.  '  <1+‘>  V'<VW-h<Vw>W> 


,-l„  r. 


9n(k)  +1^(k)(i+1)  Hih(9n(k))  +  V*  +  Sk,i  +  Tk,i 


The 


-1 


fact  that  il  t!l  ■  o(k  )  follows  from  Lemma  3.3  and  due  to  the 


-1, 


boundedness  of  h(x,y)  we  also  have  j|  ^|[  “  0(k  )  if  we  can  prove 


1C 


that 


sup  ilH  -H ,.JI  ■  °(D  • 
n(k)<i<n(k+l)  1  nw 

This  follows  easily  for  our  choics  of  H^.  Ths  tera  T,^  ^  is  crsscsd  by 
vrlclng 

“Tk.«" '  l|j00(1+1)'Vh<VW-h<Vio-W)11 


4  c14(t)<1+1)‘I|lh<9i,?wi)’h<9»00'^i>il 


sc  z  (i+irte -e  ,.Ji 

i-a(k)  1  n(k) 


S  Cp 


k  llei-6n(k) 

n(k)Si<n(k+l)  1  nW 


sines  h(x,y)  is  Llpschicz  continous  is  x.  Nov  ws  hsvs  provsd  that 


"WVk)'! s  Vk  *  *,pk>  +  Vk  9r'o(»11- 


Ths  inequality 


(3.4) 


mx  i!e  -e  ,.J|s  (c.p.4«(pt))/(i-c2p.) 

n(k)Si<n(k+l)  1  °(k)  1  k  k  rk 


for  largs  k  gives  ||T.  .  ||  *  0  (k  *).  Summarizing  ws  have  vsrified  (3.3). 

Kp  X 

Ths  second  pare  of  Che  proof  is  to  show  that  this  glvss  the  result 

stated  in  ths  theorsa.  Vs  apply  Leama  3.4  to  ths  coaponents  of  the  vector 

h(8  \)»  It  is  obvious  that  B1  holds  and  it  raaains  to  verify  B2 

n(k) 

for  all  coaponents.  Vs  start  at  h^(0Q^)  and  cake  ths  coaponents 
in  order.  Ths  convergence  of  follows  because  5^(0^^) 

satisfies  B2  since  $/(•)  is  increasing  and  odd.  For  w*  have 

h  (®n(k))  h  (9n(k))  h  (  n(k)J  h  (  n(k))  ’ 


where 


*n(k)  "  <n,an(k),*n(k),bn(k))  * 


Assumptions  A1  and  A4  implies  that  -  -6  if  an^  >  a+> 

because  x  ( * )  Is  increasing  on  (0,*)  and  even  and  the  first  part  of 
the  assumption  is  satisfied  from  the  fact  that 

ll5<2>(9»(k)>  '  E<2)(|W11  4  cllVk>-n'ls  9/2 

if  k  is  large  enough.  This  is  due  to  the  proved  part  above  and  the 
Lipschitz-continuity  of  h(x)  as  a  function  of  x.  The  second  part  of 
the  assumption  follovs  in  the  same  way.  The  convergence  of 
follows  because 


E°)(W  '  5(3,<6.<k)>  -  E<3>(W  +  E<3>(1n(k)> 

■s!!,WE<3,,W“-Vk) 


where 


*n(k)  “  (n’0,4n(k),bn(k))T  * 

The  Lipschitz-continuity  makes  it  possible  to  choose  N  such  that 

IIE<3>(Vk>>  -  5<3>(In(k)>11  S  c'H"-Vk)IMo-”n(k)ll)  9  5/2 

for  all  k  >  N,  and  this  proves  that  a  ...  ♦a.  A  similar  argument 

n  Uc; 

shows  that  b  ...  ♦  b. 

n(k) 

The  relation  II ®n(k+l)”®n(k)  H  ®  *nd  tb*  previous  result  (3.4) 
proves  the  remaining  part  of  the  theorem.  a 


4.  COMMENTS  ON  THE  ASYMPTOTIC  DISTRIBUTION  AND  ON  THE  CHOICE  OF  THE 
ADAPTIVE  MATRIX. 


In  Section  3  we  proved  strong  consistency  of  the  algorithm  (2.1).  In 

order  to  discuss  our  choice  of  H  we  also  need  results  for  the 

n 

asymptotic  distribution  of  the  algorithm. 


The  asymptotic  distribution  can  be  derived  from  a  strong  represen- 


tation  theorem  which  Is  proved  in  England ,  Holst  end  Ruppert  (1987) 
The  same  theorem  Is  stated  here  without  proof  to  facilitate  the 
discussion  below.  (By  the  notation  x  In  this  section  we  mean  a 
continuous  and  differentiable  version  of  (2.3).) 


THEOREM  4 . 1  If  Al,  A3-A5  hold  and  0q  Is  given  by  the  algorithm 
(2.1),  then  there  exists  e  >  0  such  that 


Z  a“1o«(*v) 
k-1  * 


nii(0n-6) 


+  0(n“e) , 


Z  b-1ox(tv) 
k-1  K 


di  Z  log(f)x(*k)  h-  Z  (♦•(zk)-a) 
k-1  k-1 


d,  I  log(|)X(t.)  +  I  (zvx’(0-b) 
x-1  k-l  *  * 


wh«re  xk  -  o_1(yk-n),  dj  -  b_1E(r )  and  d2  -l+b’lE(z*x"  ) 
For  a  sequence  of  ■Lnd.tpe.ndtrvC  observations  the  theorem  gives 


where 


n  (0  -0)  €  As  N(0,V) , 
n 


'  vll 

0 

0 

0 

V  - 

V2  2 

V23 

V24 

V33 

V34 

V44 

with  variance  elements 


-2  2  2 

Vu  -  a  o  E*T(z), 

-2  2  2 

v22  -  b  VEx*(z), 

V,,  -  V(*'(z))  +  2d?V(X(*))  -  2d,C(X(*) (z) ) , 
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v44  “  7(zX’<z>>  +  2d2V(x(z))  -  2d2C(x(z).zX’(z)), 

and  covariance  elements 

723  “  -dib”1°v^(z))  +  b_10C(x(z).«f>'(z)), 

V24  "  ‘<J2b"laV(x(z))  +  b'loC(X(z),zx’(z)). 

V34  -  2d1d2V(x(z))  -  d1C(X(z),ax’(z))  -  d2C(X(z) (z))  + 
+  C(*x' (z) (z)) . 


In  Cha  remaining  part  of  this  section  we  discuss  whether  Hq  In 
Section  3  la  optimal  or  If  we  can  find  a  better  one. 

Given  a  recursive  algorithm  It  la  well  known  that  the  "optimal" 
adaptive  matrix  Hopt  la  the  negative  Inverse  of  the  derlvates  of  h(9). 
Here  we  get 


H°pt 


E(*'(z)) 

E(X’(z)) 

E(o”V(z)) 

E(o~1(x,(z)+*X"(z)>) 


E(z*'(z)-*(z))  0  0 

E(zx'(z)-x(z))  0  0 

E(o~1z$”(s) )  1  0 

E(o_1(zx,(z)+z2x"(z)))  0  1 


-1 


n  this  reduces  to 

0  0  0 

b”1  0  0 

-(b  a)~lE(zV’(.z))  1  0 

-o"l(l+b_1E(z2x"(z)))  0  1  , 

where  as  above  a  -  E(*'(z))  and  b  •  E(zx'(z)).  The  values  of  a,  b, 

2 

E(z#"(z))  and  E(z  x"(z))  ere  In  general  unknown  and  if  we  try  to 

2 

estimate  E(z<^'(z))  and  E(z  x"(z))  we  get  more  elements  In  the 
parameter  vector. 

It  la  however  worth  noting  that  this  more  complicated  algorithm  may 
reduce  the  asymptotic  variances  of  a  and  b  .  If  we  assume  chat  we 


If  ^  is  odd  and  x  eve 

-1 


(4.1)  H°pt  - 


a 

0 

0 

l  0 


know  eh*  values  of  dj  ■  b  *E(z<»"(z))  and  d2  ■  1+b  ^E(z^x"(z))  and 
insert  then  and  Che  truncated  estimates  of  a  and  b  in  eh*  matrix 
H°^C  ve  gee  the  algorithm 


(4.2) 


n+1 


n+1 

*n+l 

vb;+i 


n;  +  (n+i)-1 l3f;*(u^l)/i;. 

o;  +  (n+D'^xCu^)/^, 

*;  + 

b;  *  (“+1)‘1(u;+iX,(u;+i)  -  d2x^un+l)  '  b^* 


where  u'  •  (y  ..-n'j/cr'.  It  is  easy  to  prove  that  this  algorithm 

art  Brri  n  n 

satisfies  0'  ♦  6  a.s.  and  from  the  technique  uaed  in  Englund ,  Holst 
Q 

and  Ruppert  (1987)  it  also  follows  for  ■LncLe.pi.ndint  observations  that 

nJ*(0,-0)  €  As  H(0,V,)> 
n 

where 


V11 

0 

0 

0 

V22 

V23 

V24 

V33 

->4 

7' 

44 

The  only  difference  between  V  and  V'  Is  the  elements 


V’3  -  7(*'<z))  +  dJv(X(r))  -  2d1C(X(*), ♦'(*)) 
v;4  -  V(zX'(z))  +  d2V(X(z))  -  2d2C(x(s).sx,(t)). 

-  d1d2V(x(z))  -  djC(x(t) »rx' (*))  -  d2C(x(z) . (z) )  + 

+  C(zx* (z) (z)) . 

Note  that  the  variances  7^^  and  V^4  for  the  algorithm  in  Section  2 
both  are  larger  than  and  V^. 

As  an  example  w*  take  Huber's  Proposal  2  with  k  -  1.5.  Although 


the  functions  defined  in  (1.2)  do  not  satisfy  A2  and  A3  it  is 
conjectured  in  Englund,  Holst  and  Ruppert  (1987)  that  the  theorem  is 


valid  If  d^  and  d^  ar«  intarpracad  aa  -  -2b  kf(k)  and 

dj  •  2  -  4b  *k^f(k),  vbara  f  la  tha  danalcy  of  z.  For  this  cholca  and 

Indapandanc  N(0,1)  dlacrlbutad  randoa  varlablaa  va  gac 


1.0371  0 

0 

0 

0.6894 

0.0621 

0.2797 

0.1641 

0.2262 

1.2326 

and 


'  1.0371  0 

0 

0 

0.6894 

0.0621 

0.2797 

0.0600 

0.2699 

h 

1.2143 

Obaarva  chat  b'  ■  2k2a'  -  2(k2  -  8.)  for  Hubar'a  Propoaal  2,  which 
n  n  k 

lapllaa  chat  p(a',b')  •  1  and  hanca  tha  oumbar  of  eoaponanCs  of  8' 
n  q  □ 

raducas  Co  chraa. 

It  la  our  lntantlon  to  study  algorltha  (4.2)  with  aatlaataa  of  d^ 
and  d^  In  tha  naar  futura.  For  Hubar'a  Propoaal  2  va  only  hava  Co  astl- 
aata  d^  and  chla  aakaa  uaa  of  H°^C  aora  faaalbla. 

5.  A  NUMERICAL  EXAMPLE. 


In  this  sacdon  wa  glva  a  nuaarlcal  axaapla  of  cha  adapt iva 

aaclaacor  daflnad  In  Sacdon  2  whan  (y  is  a  aaquanca  of 

Indapandanc  r.v.  with  a  contaalnacad  normal  diacrlbuclon 

0.9N(0,l)+0. 1N(0,25) .  Wa  will  uaa  Hubar'a  Propoaal  2,  daflnad  In  (1.2). 

Tha  conacane  k  la  choaan  co  l.S  which  aakaa  6^  ^  *  0.7784.  Tha 

varlablaa  o  ,  a  and  b  ara  all  truncacad  balow  by  0.1  and  abova  by 
n  n  q 

%  <V  'V/ 

10.  To  avoid  chac  bad  aarly  aadaacaa  of  a  ,  a  and  b  lnfluanca  cha 

q  q  n 

raaulca  coo  ouch  wa  taka  H  ■  I  and 

Q 


_‘*ln  . 


k 


Finally  we  mention  chat  the  asymptotic  variance  Is  1.3977 
for  cha  racurslva  estimator,  while  Che  lease  squares  estimator  has  the 
asymptotic  variance  3.4000. 
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